Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networks
نویسندگان
چکیده
In this paper, we propose two communication-efficient decentralized optimization algorithms over a general directed multi-agent network. The first algorithm, termed Compressed Push-Pull (CPP), combines the gradient tracking method with communication compression. We show that CPP is applicable to class of unbiased compression operators and achieves linear convergence rate for strongly convex smooth objective functions. second algorithm broadcast-like version (B-CPP), it also under same conditions on B-CPP can be applied in an asynchronous broadcast setting further reduce costs compared CPP. Numerical experiments complement theoretical analysis confirm effectiveness proposed methods.
منابع مشابه
A Proximal Gradient Algorithm for Decentralized Composite Optimization over Directed Networks
This paper proposes a fast decentralized algorithm for solving a consensus optimization problem defined in a directed networked multi-agent system, where the local objective functions have the smooth+nonsmooth composite form, and are possibly nonconvex. Examples of such problems include decentralized compressed sensing and constrained quadratic programming problems, as well as many decentralize...
متن کاملExtraPush for Convex Smooth Decentralized Optimization over Directed Networks
In this note, we extend the existing algorithms Extra [13] and subgradient-push [10] to a new algorithm ExtraPush for convex consensus optimization over a directed network. When the network is stationary, we propose a simplified algorithm called Normalized ExtraPush. These algorithms use a fixed step size like in Extra and accept the column-stochastic mixing matrices like in subgradient-push. W...
متن کاملDecentralized Convex Optimization for Wireless Sensor Networks
Many real-world applications arising in domains such as large-scale machine learning, wired and wireless networks can be formulated as distributed linear least-squares over a large network. These problems often have their data naturally distributed. For instance applications such as seismic imaging, smart grid have the sensors geographically distributed and the current algorithms to analyze the...
متن کاملDecentralized rate control for tracking and surveillance networks
We present a duality-based method for decentralized communication resource management in the context of networked tracking and surveillance systems. This method shares communication resources according to the joint utility provided by information of particular types. By formulating the problem as an optimization of the joint utility of information flow rates, the dual of the problem can be unde...
متن کاملDecentralized Memory Disaggregation Over Low-Latency Networks
Mosharaf Chowdhury is an Assistant Professor in the EECS Department at the University of Michigan. His research ranges from resource disaggregation in low-latency RDMA networks to geo-distributed analytics over the WAN, with a common theme of enabling applicationinfrastructure symbiosis across different layers of corresponding software and hardware stacks. [email protected] Memory disaggregati...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Signal Processing
سال: 2022
ISSN: ['1053-587X', '1941-0476']
DOI: https://doi.org/10.1109/tsp.2022.3160238